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We give a pedagogical introduction to quantum discord. We the discuss the problem of sepa- 
ration of total correlations in a given quantum state into entanglement, dissonance, and classical 
correlations using the concept of relative entropy as a distance measure of correlations. This allows 
us to put all correlations on an equal footing. Entanglement and dissonance, whose definition is 
introduced here, jointly belong to what is known as quantum discord. Our methods are completely 
applicable for multipartite systems of arbitrary dimensions. We finally show, using relative entropy, 
how different notions of quantum correlations are related to each other. This gives a single theory 
that incorporates all correlations, quantum, classical, etc. 



INTRODUCTION 

Quantum systems are correlated in ways inaccessible to 
classical objects. A distinctive quantum feature of corre- 
lations is quantum entanglement [TH3]. Entangled states 
are nonclassical as they cannot be prepared with the help 
of local operations and classical communication (LOCC) 
[3]. However, it is not the only aspect of nonclassicality 
of correlations due to the nature of operations allowed in 
the framework of LOCC. To illustrate this, one can com- 
pare a classical bit with a quantum bit; in the case of full 
knowledge about a classical bit, it is completely described 
by one of two locally distinguishable states, and the only 
allowed operations on the classical bit are to keep its 
value or flip it. To the contrary, quantum operations can 
prepare quantum states that are indistinguishable for a 
given measurement. Such operations and classical com- 
munication can lead to separable states (those which can 
be prepared via LOCC) which are mixtures of locally in- 
distinguishable states. These states are nonclassical in 
the sense that they cannot be prepared using classical 
operations on classical bits. 

Recent measures of nonclassical correlations are moti- 
vated by different notions of classicality and operational 
means to quantify nonclassicality [SHU]. Quantum dis- 
cord has received much attention in studies involving 
thermodynamics and correlations [l2l ? -[21] . These works 
are concerned with understanding the role of quantum- 
ness of correlations in a variety of systems and tasks. In 
some of the studies, it is also desirable to compare var- 
ious notions of quantum correlations. It is well known 
that the different measures of quantum correlation are 
not identical and conceptually different. For example, 
the discord does not coincide with entanglement or mea- 
surement induced disturbance and a direct comparison 
of any two of these notions can be rather meaningless. 
Therefore, an unified classification of correlations is in 
demand as well as a unification of different notions of 
quantumness. In this article, using relative entropy, we 
resolve some of these issues by introducing measures for 




H{ab) 

FIG. 1. Conditional entropy. The Venn diagram shows the 
joint entropy H{ab), marginal entropies H{a) and H{b), con- 
ditional entropies, H{a\b) and H{b\a), and mutual informa- 
tion /(a : 6) a joint classical probability distribution for (cor- 
related) random variables a and h. 

classical and nonclassical correlations for quantum states 
under a single theory. Our theory further allows us to 
connect different notions of quantumness. This will allow 
us to generalize all measures of quantumness for multi- 
partite systems in symmetric and asymmetric manners. 
We begin with a pedagogical introduction to quantum- 
ness of correlations. 

CONDITIONAL ENTROPY 

The story of quantumness of correlations beyond- 
entanglement begins with the non-uniqueness of quan- 
tum conditional entropy. In classical probability theory, 
conditional entropy is defined as 

H{b\a) ^ H{ab) - H{a). (1) 

It is the measure ignorance of b has given some knowl- 
edge of state of a. Fig. [T]) depicts this relationship in 
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a graphical manner. Another way to express the con- 
ditional entropy is as the ignorance of b when the state 
of a is known to be in the ith state, weighted by the 
probability for ith outcome as 

Hib\a)=Y,ptH{b\a^z), (2) 

i 

It is the classical-equivalency of Eqs. [l] and [2] give rise 
to quantumness of correlations and in specific quantum 
discord [55]. This is due to the fact that these two equa- 
tions are not the same in quantum theory. While the 
first simply takes difference in the joint ignorance and 
the ignorance of a, the second formula depends on spe- 
cific outcomes of a, which requires a measurement. Mea- 
surements in quantum theory are basis dependent and 
change the state of the system. 

In generalizing the classical concepts above to quantum 
we replace joint classical-probability distributions with 
density operators and Shannon's with von Neumann's 
entropy. How do we deal with conditional entropy then? 
Clearly there are two options: Eqs. [T]and[2] Let is deal 
with Eq. [T] first and define quantum conditional entropy 
as 

S'-^HbIA) = S{AB)- SiA). (3) 

This is well known quantity in quantum information the- 
ory |23] and negative of this quantity is known as coher- 
ent information. However, this is a troubling quantity 
as it can be negative for entangled states and for a long 
time there was no way to interpret the negativity. This 
is in start contrast with the classical conditional entropy 
which has a clear interpretation and is always positive. 

On the other hand, we can give define the quantum 
version of Eq. |2] by making measurements on party A. 
To put in the details, the joint state p"^^ is measured by 
A giving ith outcome: 

pAB ^ ^ nfp^^Uf = ® pf , (4) 

i i 

where H^ are rank one positive operator values measures, 
\i) are classical flags on measuring apparatus indicating 
the measurement outcome, pi = Tr[Hf p^^] is probabil- 
ity of ith. outcome, pf — TrA[^fp^^]- The conditional 
entropy of B is then clearly defined as 

S'-'HbIA) = S{B\m) = Y^p^pf), (5) 

i 

This definition of conditional entropy is always positive. 
The obvious problem with this definition is that the state 
p^^ changes after the measurement. Also note that this 
quantity is not symmetric under party swap. 

A different approach to conditional entropy is taken in 
[241 125j , where a quantum conditional amplitude (analo- 
gous to classical conditional probability) is defined such 



that it satisfies Eq. [Sj We only mean to suggest that 
the two approaches above are not the only options avail- 
able. Different approaches give us different distinctions of 
quantum theory from the classical theory. And in some- 
way different notions of quantumness. 

QUANTUMNESS OF CORRELATIONS 

Clearly the two definition of conditional entropies 
above are different in quantum theory. The first one suf- 
fers from negativity and second one is 'classicalization' 
of a quantum state. Let us now derive quantum discord 
and relate it to the preceding section. We start with the 
concept of mutual information: 

I{a : b) = H{a) + H{h) - H{ab) (6) 

and using Eq. [2] 

J{b\a) = H{b)-Y,PtHib\a^z). (7) 

i 

Clearly the two classical mutual information above are 
the same, but not in quantum theory This is precisely 
what was noted by Ollivier and Zurek, and they called 
the difference between / and J quantum discord: 

5{B\A)^I{A:B)-J{B\A). (8) 

Working out the details one finds that quantum discord 
is simply, 

S{B\A) ^ S'^^\b\A) ~ S'^^\b\A), (9) 

the difference in two definition of conditional entropy. 

Henderson and Vedral [S] had also looked at J{B\A) 
called it classical correlations. In fact they advocated 
to that maxjni} J{B\A) to be the classical correlations. 
Which meant that quantum discord is best defined as 

S{B\A) = unn[I{A:B)-J{B\A)]. (10) 

Since conditional entropy in Eq. [5] is asymmetric under 
party swap, quantum discord is also asymmetric under 
party swap. 

A side note should be made at this point. The inter- 
pretation of negativity of quantum conditional entropy 
in Eq. |3] was given in terms of task known as state 
merging [27|, and we will see shortly that a similar task 
gives quantum discord an operational meaning. While 
the minimum of Eq. [5] over all POVM is related to en- 
tanglement of formation between B and C, a purification 
of AB: Ef{BC) = min{n,} S'^^) (B|A) [2g. Putting the 
two together leads to an task dependent operation inter- 
pretation of quantum discord [20J. Barring the details, 
we can say that quantum discord between A and B, as 
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FIG. 2. Correlations as a distance. The large ellipse repre- 
sents the set of all states with the set of separable states in 
the smaller ellipse. The squares represent the set of classical 
states, and the dots within the squares are the sets of product 
states, p is an entangled state and o is the closest separable 
state. The correlations are entanglement, E, discord, D, and 
dissonance, Q. 

measured by A is equal to the consumption of entangle- 
ment in state preparation of BC plus state merging in 
those two parties. Additionally, state merging and other 
tasks that involve conditional entropies are asymmetric 
under party swap and a natural interpretation of asym- 
metry of quantum discord arises. 

The minimization over all POVM of quantum is not 
an easy problem to deal with in general. A similar quan- 
tity called measurement induced disturbance (MID) was 
introduced to deal with this difficulty. MID is defined as 
the difference in the mutual information of a joint state, 
p^^ and it's dephased version ■ The dephasing takes 
place in the marginal basis, leaving the marginal states 
unchanged: 

MID = /(/^) - I{x^^) = S{p^^) - S{x^^). (11) 
We will come back to MID later in the article. 

UNIFICATION OF CORRELATIONS 

Both of the measures above are defined in terms of mu- 
tual information and therefore very difficult to generalize 
for multipartite case I^Hj- Below we will get over that 
hurdle by examining classical states, states that have no 
quantum correlations. It is easy verify that a state has 
zero discord and MID simultaneously. What that means 
is that such a state has equal value for conditional en- 
tropies in Eqs. |3]and[5j Such a state is called a classical 
state and has the form 

X^"" ^Y.P^\t}{i\®pf (12) 

i 

when measurements are made by A and x"*^ = pj^ ® 
Pj\j){j\ when measurements are made by B. It is then 



easy to see that a symmetric classical state must have 
the form 

X^"" ^Y.P^M{ij\- (13) 

ij 

Further the conditional amplitude defined in (211 US] is 
not a density operator and may behave strangely. In |26j 
it is shown that the conditional amplitude reduces to a 
density operator when the state is classical. 

Based on the definition of classical states we may now 
introduce a measure of quantum correlations as a dis- 
tance from a given state to the closest classical state. 
The distance from a state to a state without the desired 
property (e.g. entanglement or discord) is a measure of 
that property. For example, the distance to the closest 
separable state is a meaningful measure of entanglement. 
If the distance is measured with relative entropy, the re- 
sulting measure of entanglement is the relative entropy of 
entanglement 131] . Using relative entropy we define 
measures of nonclassical correlations as a distance to the 
closest classical states [TT|, though many other distance 
measures can serve just as well [18 . Wc call our measure 
of quantum correlations relative entropy of discord. 

Since all the distances are measured with relative en- 
tropy, this provides a consistent way to compare differ- 
ent correlations, such as entanglement, discord, classical 
correlations, and quantum dissonance, a new quantum 
correlation that may be present in separable states. Dis- 
sonance is a similar notion to discord, but it excludes 
entanglement. Lastly, here we have to make no men- 
tion of whether we want a symmetric discord measure or 
asymmetric, or the number of parties to be involved. We 
simply have to choose the appropriate classical state and 
no ambiguity is left. A graphical illustration is given in 
Fig. [2} 

Let us briefly define the types states discussed below. 
A product state of A^-partite system, a state with no cor- 
relations of any kind, has the form of tt = tti (g) • • • (g) ttjv, 
where 7r„ is the reduced state of the nth subsystem. 
The set of product states, P, is not a convex set in 
the sense a mixture of product states may not be an- 
other product state. The set of classical states, C, 
contains mixtures of locally distinguishable states x = 
Y.k^Pki...kN\ki---kN){ki-.-kN\ = Y.kPk\^){k\, where 

is a joint probability distribution and local states |fc„) 
span an orthonormal basis. The correlations of these 
states are identified as classical correlations [Mil fTT] . 
Note that C is not a convex set; mixing two classical 
states written in different bases can give rise to a nonclas- 
sical state. The set of separable states, 5, is convex and 
contains mixtures of the form a = X^iPi^i*^ ® ■ ■ ■ ® tt^J^ 
These states can be prepared using only local quantum 
operations and classical communication [35] and can pos- 
sess nonclassical features [5] [5] . The set of product states 
is a subset of the set of classical states which in turn is 
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a subset of the set of separable states. Finally, entan- 
gled states are all those which do not belong to the set 
of separable states. The set of entangled states, is not 
a convex set either. 

The relative entropy between two quantum states x 
and y is defined as S'(a;||?/) = — tr(xlog?/) — S{x), where 
S{x) = — tr(a;loga:) is the von Neumann entropy of x. 
The relative entropy is a non-negative quantity and due 
to this property it often appears in the context of distance 
measure though technically it is not a distance, e.g. it is 
not symmetric. In Fig. [3| we present all possible types 
of correlations present in a quantum state p. Tp is the 
total mutual information of p given by the distance to the 
closest product state. If p is entangled, its entanglement 
is measured by the relative entropy of entanglement, E, 
which is the distance to the closest separable state tr. 
Having found a, one then finds the closest classical state, 
X<j, to it. This distance, denoted by Q, contains the rest 
of nonclassical correlations (it is similar to discord [F, 
IS] but entanglement is excluded). We call this quantity 
quantum dissonance. Alternatively, if we are interested in 
relative entropy of discord, D, then we find the distance 
between p and closest classical state Xp- Summing up, 
we have the following nonclassical correlations: 



E =miiiS{p\\a) (entanglement), 
D =imTiS{p\\x) (quantum discord), 
Q =mm S{a\\x) (quantum dissonance). 



(14) 
(15) 
(16) 



Next, we compute classical correlations as the minimal 
distance between a classically correlated state, X; ^^'^ 
a product state, tt: C = min^gp ^(xllTr). Finally, we 
compute the quantities labeled Lp and in Fig. [Sj 
which give us additivity conditions for correlations. 

Skipping the details of the calculations (presented in 
[TT] ) we give the final results. The surprisingly simple 
results and is summarized in Fig. [3] First, we find that 
the closest classical state is obtained by making rank one 
POVM measurement on the quantum state 



J2\k){k\p\k){ki 



(17) 



where |fc) is projection in space at most of dimension (P. 
To find relative entropy of discord one has to optimize 
over all rank one POVM. 

D = Sip\\x)^unnS{x)-S{p). (18) 

Therefore finding the closest classical state is still a very 
difficult problem and has the same challenged as faced in 
computing original discord. 

We find that all correlations (except entanglement) in 
Fig. [3]are given by simply taking the difference in entropy 
of the state at tail of the arrow from the entropy of the 




FIG. 3. Correlations tn a quantum state. An arrow from 
X to y, X ^ y, indicates that y is the closest state to x as 
measured by the relative entropy ^(a;!!?/). The state p £ £ 
(the set of entangled states), ct G 5 (the set of separable 
states), X £ C (the set of classical states), and tt G "P (the 
set of product states). The distances are entanglement, E, 
quantum discord, D, quantum dissonance, Q, total mutual 
information, Tp and T^, and classical correlations, Co- and 
Cp. All relative entropies, except for entanglement, reduce to 
the differences in entropies of y and x, ^(a;!!?/) — S{y) — S{x). 
With the aid of Lp and L„ the closed path are additive. 



state at the tip of the arrow, i.e. S'(a;||?/) — S{y)~S{x) for 
all solid lines. Which means that a closed loop of (solid 
lines) yield correlations that are additive, i.e. D + Cp = 



or Tp-Cp = D- 



Lp , which is actually the original 



Tp+L, 

discord. We show how these two measures are related to 
each other below. See [TT for details presented in this 
section. 



UNIFYING QUANTUMNESS MEASURES 

Next we note, there are four fundamental elements in- 
volved in study of quantumness of correlations. The first 
of it is the quantum state, p. Given a quantum state we 
immediately have its marginals, TTp. The third element 
is the classical state Xi obtained by dephasing p in some 
basis. And the final element is the marginals of Xp- It 
then turns out that different measures of quantumness 
are different because they put different constrain in the 
relationships these four elements have with each other. 
We have illustrated this in Fig. [4] 

In Fig. [4^ the four fundamental elements are shown. 
Figs. [4]D-d show how three measures of quantumness 
are found using the four elements. The original dis- 
cord maximizes the distance from the classical state and 
its marginals. This has the meaning that the classical 
state is least confusing from its marginals. Quantum 
discord is the defined as the difference in confusion of 
a quantum state with its marginals and the a classical 
state obtained from that quantum state and it confusion 
with its marginals. Similarly MID attempts to minimize 
the confusion between the classical state and marginals 
of the original quantum state. This has the effect that 
the marginals of the quantum state are the same as the 
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FIG. 4. Measures of quantumness. a. Fundamental elements 
needed in defining a measure of quantumness of correlations, 
b. Original quantum discord, c. Measurement induced dis- 
turbance, d. Relative entropy of discord. 



marginals of the classical state. Finally relative entropy 
of discord is defined as the distance between a quantum 
state and its closest classical state. 

We now turn our attention to show that using relative 
entropy we can describe (and generaUze) other quantum- 
ness measures such as original quantum discord [6], sym- 
metric quantum discord |10) . and measurement induced 
disturbance. [S]. 

Vedral et al. [34] show that quantum relative entropy 
has the operational meaning of being able to confuse two 
quantum states. The argument goes as the following: 
suppose you are given either p or a and you have to 
determine which by making N measurements (POVM). 
The probability of confusing the two states is 



N 



- p-NSip\\c7) 



(19) 



Now suppose p is an entangled state. Then for what 
separable state a can be confused for p the most? The 
answer is 



P, 



N 



-Af minxes S{p\\(j) 



where S is the set of separable states. This is the meaning 
of relative entropy of entanglement: 



E{p) = niin5(p||cr). 



(21) 



In similar manner we can give meaning to relative en- 
tropy of discord as 



Dip)^mmSip\\x) 



(22) 



the classical state x that imitates p the most. 

The great advantage of looking at these measures in 
this manner is that, now they are no longer constrained 



to be bipartite measures. Nor they are constrained to be 
symmetric or asymmetric under party exchanges. We can 
now define quantum discord by n— partite systems with 
measurements on m subsystems. Similarly, MID can be 
defined in such a manner as well. The other advantage 
is that we know how these elements are related to each 
other and that there are only finite number of relation- 
ships among them that make sense, e.g. maximization of 
distance between a quantum state and a classical state 
does not make sense as on may get infinity for the result. 



CONCLUSIONS 

We have given a pedagogical review of ideas behind 
quantum correlations beyond entanglement. In doing 
so we were able to generalize the concepts of quantum 
discord to multipartite case, with no ambiguity regard- 
ing the asymmetry of quantum discord under party ex- 
change. We have shown how three measures of quan- 
tumness can be viewed under a single formalism using 
relative entropy. 
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Research Foundation and the Ministry of Education of 
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years of entanglement in Kolkata for inviting our partic- 
ipation. 
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